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This article provides a review of recent developments in the formulation and execution of optimal 
control strategies for the dynamics of quantum systems. A brief introduction to the concept of 
optimal control, the dynamics of of open quantum systems, and quantum information processing 
is followed by a presentation of recent developments regarding the two main tasks in this context: 
state-specific and state-independent optimal control. For the former, we present an extension of 
conventional theory (Pontryagin's principle) to quantum systems which undergo a non-Markovian 
time-evolution. Owing to its importance for the realization of quantum information processing, 
the main body of the review, however, is devoted to state-independent optimal control. Here, we 
address three different approaches: an approach which treats dissipative effects from the environment 
in lowest-order perturbation theory, a general method based on the time-evolution superoperator 
concept, as well as one based on the Kraus representation of the time-evolution superoperator. 
Applications which illustrate these new methods focus on single and double qubits (quantum gates) 
whereby the environment is modeled either within the Lindblad equation or a bath of bosons (spin- 
boson model). While these approaches are widely applicable, we shall focus our attention to solid- 
state based physical realizations, such as semiconductor- and superconductor-based systems. While 
an attempt is made to reference relevant and representative work throughout the community, the 
exposition will focus mainly on work which has emerged from our own group. 



Contents 



I. Introduction [T] 

A. Preliminaries and overview ^ 

B. The optimality system [2] 

1. The cost functional [5] 

2. Optimality conditions [3J 

3. Markovian kinetic equation [3J 

C. Numerical aspects S] 

II. Application of optimal control theory to 

quantum information processing U] 

A. Introduction to quantum information 
processing [4] 

B. Dynamics of quantum systems [5] 

1. Unitary and non-unitary time-evolution [5] 

2. Models of dissipation and decoherence [H] 

C. State-selective versus state-independent 
optimal control [7] 

III. State selective optimal control of open 

quantum systems [7] 

A. Markovian kinetic equations [3J 

1. Direct inversion [8] 

2. Choice of the trajectory: decoherence free 
subspace [3J 

3. Two-level system [5] 

4. Example [9] 

5. State-dependent optimization within the 
spin-boson model [TO] 

B. Non-Markovian kinetic equation [TO] 
1. Minimality conditions via the Lagrangean 

multiplier technique [TO] 



2. Minimality conditions via Hamilton's 
variation principle (Pontryagin's principle) [TO] 

3. Application [14] 

C. Application to electron spin in quantum dots [T7] 

D. Control strategies - summary [TO] 

IV. State-independent optimal control [TO] 

A. Perturbative approach [20] 

B. Superoperator formulation of 
state-independent control [22] 

1. Kinetic equations [55] 

2. Representation of the superoperators and 

the Lindblad dissipator [55] 

3. Cost functional [23] 

4. An example: The CNOT gate [53J 

5. Hamiltonian of the system [53J 

6. Dissipation and Lindblad-operators [53] 

7. Numerical study [53J 

C. Optimal control within the Kraus operator 
representation [5J] 

V. Conclusion and outlook [5H 

VI. Acknowledgment l26l 

References [55] 



I. INTRODUCTION 
A. Preliminaries and overview 

Recent developments throughout modern nanophysics, 
both regarding physical phenomena and technological ap- 
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plications, have pushed the development of theoretical 
approaches for the optimal control of the dynamics of 
open quantum systems. While the field of quantum infor- 
mation processing is still open for new ideas, solid-state 
based realizations, such as semiconductor quantum-dot 
systems and Josephson-junction based quantum gates, 
have emerged as major candidates. Appealing features 
are the high levels of technological abilities regarding de- 
sign and fabrication of the se systems, a s well as their 
scalability into large arraysP^- 2 * 3 * 4 * 5 * 6 * 7 *^ Current draw- 
backs are isolation problems of solid-state quantum sys- 
tems from their environment on time-scales where exter- 
nal control can be administered, the complexity of con- 
trolled fabrication of these artificially grown structures, 
as well as the generation and precise application of suf- 
ficiently strong control fields. Since quantum interfer- 
ence, generally, is a frail effect on a mesoscopic length 
scale, it stands to reason to apply optimal control the- 
ory to maximize ones ability to steer nanostructures in 
quantum-coherent fashion. In this article we shall re- 
view recent progress in this direction, focusing on recent 
progress within our group. 

Optimal control theory (OCT) generally concerns itself 
with algorithms for finding control fields which minimize 
or maximize a given performance index, often called cost 
functional. As such, OCT represents an example for an 
inverse problem. The fundamental prerequisite to for- 
mulate and apply OCT is the ability to express the con- 
trol objective, as a quantitative mathematical criterion, 
i.e., in form of a cost functional. Typical is also the 
presence of additional constraints. In fact, there is an 
enormous number of problems for which the latter can 
be formulated in form of differential equations. Proba- 
bly the most famous example in physics is provided by 
classical mechanics, however, this type of problem can be 
found throughout quantitative science. 

The basic mathematical description for an optimal 
control problem can be given as follows.^ Suppose we 
have a set M and a functional J(v) , with v S M . M corre- 
sponds to the space of solutions and v is an arbitrary par- 
ticular solution to the problem. The functional J maps IM 
onto the set of Real numbers, i.e., J : IM — > R, and charac- 
terizes the quality of v so that if solution v\ is better than 
i>2, then J(vi) < J(v2). The best, and therefore called 
optimal solution is defined as v* = argmin, ugM J(v). The 
pair (M, J) is a mathematical model of our control prob- 
lem. Much of this work deals with proper modeling of 
dynamical processes. Here, the cost functional J usually 
depends on a set of state variables, whose dynamics is 
governed by (integro-) differential equations. By proper 
tuning of the controls it is possible to alter the evolution 
of these state variables and to find an extremum of the 
cost functional. 

OCT has its origins in the calculus of variations, es- 
pecially in curve minimization problems to which con- 
siderable attention has been paid at the end of the 17th 
century. 11 Since then, there has been an ongoing advance- 
ment in the field of optimization which culminated in the 



work of Pontryagin and Bellman in the 1950s. Nowadays 
OCT is used in many different areas including engineer- 
ing, finance, economics and physics. Below, we shall take 
a closer look on the latter, namely optimal control of dis- 
sipative or open quantum systems with a particular focus 
on quantum information processing (QIP). We start out 
in Sec. |IB| with a brief review of standard optimal control 
theory in the presence of constraints in form of differen- 
tial equations (kinetic equations), associated numerical 
approaches, the dynamics of open quantum systems, and 
models for dissipation and decoherence. Sec. |TT] gives 
a brief account of quantum subsystems. The main part 
of the paper discusses state-selective optimal control for 
Markovian and non-Markovian quantum systems in Sec. 
|III[ and state-independent optimal control in Sec. |IV| 
Relevant physical examples are given in the respective 
chapters. Sec. [V] gives a summary and an outlook. 

B. The optimality system 

We confine ourselves to a brief introduction to stan- 
dard optimization theory for continuous syste ms. D e- 
t ailed expositions may be found in the literature! 10 * 12 ! 

1. The cost functional 

We consider a continuous system and denote its state 
vector by x(t) and the control by e(t). In general, both, 
state vector and the control, will be multi-dimensional. 
The former is an element of a linear vector space. The 
most general case of dynamics of the state vector x(t) 
we are considering is described by an integro-differential 
equation, 

t 

jx{t) = J dt'f{x{t'),e{t'),t,t'), (1) 

to 

which may be nonlinear in x. The integral kernel 
f(x(t'),e(t'),t,t') depends on two times: the current 
time t and a time t' accounting for th e past t' < t. The 
cost functional can be written as) 12 * 13 * 

*/ 

J[as,e](x ,*0i*/)= / dtL(x(t),s{t),t)+$(x(tf),tf), 

to 

where L(x(t) , e(t) ,t) is often called the running cost or 
the Lagrangean and $(x(tf), tt) is the terminal cost. 
Eq. |2]) is referred to as Bolza type, whereas cost func- 
tional containing only the terminal or running penalty 
are called Mayer or Lagrange type, respectively! 13 * 1 ^ 

The choice of the particular form of the cost func- 
tional reflects the desired objective to be achieved. If 
we want to steer our system into a given final state 
Xf, the straightforward choice is to set L — and 
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<5>(x(tf),tf) = — (x(tf),Xf), where (., .) denotes a real- 
valued scalar product defined in the linear state-vector 
space. Another common choice for the Lagrangean is, 
L(x(t),e(t),t) — ~ (xjy(t),x(t)}. Here we want the sys- 
tem's state variable to follow a given desired trajectory 
xd{€). If we set xr>(t) = Xd = const., the system, 
when subjected to the corresponding optimal solution, 
approaches the desired state xd as fast as possible and 
tries to stay in that state, which is often called "state 
trapping" . 

The dependence of the Lagrangean on e and e (the lat- 
ter was not explicitly included above) allows the imple- 
mentation of additional constraints on the control, such 
as shape, duration rate of change, or intensity. Due to 
physical considerations it is sometimes reasonable to in- 
clude a constraint imposed on the control intensities, i.e. 
to choose a Lagrangean of the form L{x[t) , e(t) , t) = 
L'(x(t),t) + a \e(t)\ 2 , which penalizes large control field 
intensities, where a characterizes the degree of penalty. 
In fact, such a constraint may be mandatory to render the 
optimization problem well-defined mathematically. (See 
Sec. Ill and Ref. ITtJll. If one desires control fields which 



vanish at to and tf it is convenient to use a penalty func- 
tion which depends on time, i.e., a — > a(t) and which 
takes on large values near initial and final time. The 
time derivative i(t) can be included in the Lagrangean 
to introduce a means for suppressing unphysically rapid 
variations in the control field in the cost functional explic- 
itly, as well as to preserve an analogy to the formalism 
of classical mechanics in form of a velocity-dependent 
Lagrangean. 



3. Markovian kinetic equation 

If the Kernel / is local in time, Eq. ([TJ) reduces from 
an integro-differential equation to a differential equation. 
Then, adjoining the system differential equations by the 
use of Lagrangean multipliers A(t), often called co-state, 
one may formulate a new cost functional, 



J = / dt{L(x,s,t) + (\(t),x(t) - f(x,e,t))} 



+<Z>(x(t f ),t f ). 



(5) 



Now the differential equation constraint has been incor- 
porated. By proper choice of the multipliers X(t), (see 

Eq. ([7])), we can eliminate the dependence of ^ on j^. 
If we define the Hamiltonian, 

H(x, s, A, t) = L(x, s, t) + (A, f(x, s, t)) , (6) 

and apply the calculus of variations, the necessary con- 
ditions for an optimal point can be derived (see Ref. IT^|l , 
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t=t f 

x(t) = f(x,e,t), 
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dL 

~de~ 



X(t),—f(x,s,t) 



2. Optimality conditions 

The optimal control field is defined by, 

e*(x ,t ,tf) = argmin {J[x,e](x ,t ,t f )} . (3) 
eec 2 [t ,t f ] 

A necessary condition for an optimal point is, 
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dt 



I SL(x,e,t) Sx\ 5L(x,e(t),t) 
\ 5x ' 8s I 5s 



(4) 



However, at least for analytical investigations of the opti- 
mality system, Eq. Q is not very useful because x(t) de- 
pends implicitly on s[t) . The variation of x with respect 
to e, j^, may be complicated (nonlocal in time). Most 
formulations of the optimality system which circumvent 
this problem are based on Lagrangean multipliers. The 
next subsections will consider the formulation of such an 
approach for Markovian systems. Application to non- 



Mar kovian quantum systems will be given in Sec. |III B 



These equations take the form of Hamilton's equations of 
motion of classical mechanics and are referred to as Pon- 
tryagin's minimum principle. T hey ar e simultaneously 
satisfied for an optimal trajectory! 10 * 15 ! 

One of the first applications of OCT to quantum sys- 
tems has been the theoretical examination of how to con- 
trol the final state of a diatomic molecule.^ A similar ap- 
proach based on a variational principle has been used to 
maximize the probability of a certain pathway in a chem- 
ical reaction by using coherent two-photon processes.^ 
The use of Lagrangean multipliers and the similar Kro- 
tov method is quite common! 18 ! 19 ! These techniques have 
been applied to a broad r ange of quantum mechani- 
cal problems! 20 1 21 1 22 1 23 1 24 1 25 1 A comparison between the 
Krotov method and gradient methods can be found in 
Ref. M 

When OCT is applied to quantum mechanics, typical 
examples for st ate ve ctors x(t) are wave wave functions- 
functions |V,(^))12 2 J26J or density matrices p^)! 24 ' 25 ' 27 '^) 
In the quantum computation context, the elements of 
the unitary time evolution operators U(t) are a common 
choice for x because initial state-independent optimiza- 
tion s chemes ar e necessary in order to optimize quantum 
gates ESEnMEU Recently, time-evolutio n supero perator- 
based formulations have been proposed! 30 * 31 * 32 ! 
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C. Numerical aspects 

The variational calculus provides the necessary condi- 
tions for an extremum of J in form of gradients which 
may be used as input to a broad range of numerical 
schemes which search for minima of a function for which 
both function and gradients are available analytically.^ 
However, deriving the co-state equations for an open 
quantum system often is a tedious task and one may 
want to use a solely numerical method to compute the 
gradients. One possibility is to discretize the control field 
e(t) in time, 

t -> t n = nh, with n € [0,N], t f = Nh + t , 
e(f) -> e„ = e(t n ), 
h ... grid spacing, 

and to compute the gradient of the cost functional di- 
rectly via finite differences, 

8 J ( 5 J 6 J 5 J \ 
Se \5eo ' 6e± ' ' 5s n J ' 

SJ_ _ J (go, ...,£„ + Ae», ...) - J (gp, ...,£„, ...) 

5e n Ae n 

The price paid when using finite differences is a signif- 
icant loss in numerical stability relative to the indirect 
variational method introducing a co-state and care must 
be taken in identifying the parameter range over which 
meaningful results are obtained so that convergence can 
be reached.^ Usually, the extra effort spent in deriving 
and evaluating co-state equations pays dividends when 
performing the optimization numerically. 

Using the gradient j^, one can utilize e.g. a conju- 
gate gradient method to search for a minimum of the 
cost functional. ^However, such a method is prone to get 
stuck in local minima and convergence may be slow when 
the initial guess is poor. Instead one can use global search 
algorithms, the most prominent being stochastic func- 
tion minimizers, like genetic and differential evo lution 
algorithms or simulated annealing! 21 1 34 1 35 1 36 1 37 1 38 1 These 
methods have the advantage that no calculation of the 
gradient is needed and that it is more likely to find a 
global minimum of the cost functional. On the other 
hand, these algorithms usually need lots of cost func- 
tional evaluations which may be computationally expen- 
sive. 

For all numerical implementations the control scheme 
has to be executed on a time grid. The upper limit in grid 
size is usually determined by the numerical requirements 
posed by the differential equations for state and co-state. 
In principle one may discretize the control using the same 
gridPS This quickly leads to a control field vector of high 
dimension and an according number of field gradients 
which makes computation time consuming. Frequently 
it is advantageous when physical intuition or experimen- 
tal limitations narrow down the solution space. In par- 
ticular, parameterising the control has been shown to 



provide significant speedup and reduction in numerical 
complexity. 



II. APPLICATION OF OPTIMAL CONTROL 
THEORY TO QUANTUM INFORMATION 
PROCESSING 

A. Introduction to quantum information processing 

In 1982 Feynman published a paper in which he dis- 
cusses the question of whether it is possible to simulate 
quantum mechanics effectively using a classical (prob- 
abilistic) computer "Effective" here means that the 
computational resources, (i.e., computation time and 
memory) scale polynomially, as opposed to exponentially, 
with the size of the physical system to be simulated. He 
also introduced the concept of a quantum computer as 
a universal quantum simulator which uses "quantum el- 
ements" in order to simulate another quantum system. 
For a quantum computer, such a "quantum element" is 
the quantum bit or qubit, which can be seen as the quan- 
tum mechanical analogue to the classical bit. The differ- 
ence with respect to the classical bit, which is either in 
the state or 1 , is that a qubit can be in a superposition 
state . If we denote the computational basis states of 
the quantum two level system by |0) and |1), the pure 
state Co |0) + c\ |1), with Cj G C and |co| + |ci| = 1, is 
also a valid qubit state. Another difference arises if we 
examine n-partite systems, e.g. a two-partite system. 
For a classical 2-bit system it is always possible to assign 
a definite state to each of it is components whereas for 
a two-qubit system this is not always possible. If two 
qubits are entangled, e.g. if they are in the pure state 
^= ( 1 00) + 1 11)), only the composite system is in a defi- 
nite state. 

In addition to pure states, a quantum system can also 
be in a mixed state represented by a density operator 
To visualize the state of a single qubit one often uses the 
so called Block sphere and Block vector. Any qubit state 
p, pure or mixed, can be written as, 

p= l -(l + R-a) 1 (8) 

where R = (x,y,z) is the real Bloch vector, \R\ < 1, 
and a is the spin-vector, containing the Pauli-matrices 
crj, % = x,y,z. By rewriting the pure state of a qubit, 
\ip) = c |0) + d \1) into \<<p) = sin § |0) + e^cos \ |1), 
we may use the angles 9,<j) to represent \ip) by a vector 
(the Bloch vector), with length 1 for pure states, which 
points to a specific point on the surface of a unit sphere 
(the Bloch sphere), see Fig.[l] 

Within the circuit model of quantum computing, every 
quantum algorithm can be decomposed into elementary 
operations which corr espond to unitary transformations 
on the qubits, see Fig.[2f 4 ^Hln analogy to classical com- 
puting one can identify universal quantum gates. It has 
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FIG. 1: Bloch sphere and Bloch vector. 



been shown that one-qubit operations together with the 
so called controlled NOT (CNOT) gate, which is a op- 
eration on two qubits, is universal for quantum comput- 
m g@3] However, the particular choice of the CNOT gate 
is not mandatory. It has been proven that almost every 
gate that operates on two or more qubits represents an 
universal gateP^ 
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FIG. 2: (a) Decomposition of a classical algorithm into ele- 
mentary gates. Universal gate: e.g. NAND. (b) Decomposi- 
tion of a quantum algorithm. Universal gates: e.g. one qubit 
operations, Ui, together with the controlled NOT (CNOT). 



B. Dynamics of quantum systems 

1. Unitary and non-unitary time-evolution 

When a quantum system is perfectly isolated from its 
environment the dynamics is governed by the unitary 
time evolution operator, U{t) = U(t,0). 



U(t)=Texp{-- I H(t')dt'}, (9) 



with the system Hamiltonian, 

H(t) = H +H c (t), (10) 

where Hq denotes the Hamiltonian of the intrinsic quan- 
tum system and H c the control part. The wave function 
evolves accordingly, 



m)) = u(t) \m) 



(ii) 



The basic equation of motion for an isolated quantum 
system in a mixed state p is the von Neumann equation,^ 



(12) 



If we are dealing with open quantum systems, e.g., 
a system S which is in contact with an environment 
B, the resulting time-evolution for subsystem S is non- 
unitary in general. This means a description based upon 
the Schrodinger or von Neumann equation is no longer 
appropriate for S. In order to compute the dynam- 
ics of open quantum systems one can use a stochastic 
Schrodinger equation!^ However, the general approach 
to deal with the non-unitary time evolution of a sub- 
system is to start from a suitably enlarged composite 
quantum system which obeys the von Neumann equa- 



tion Eq. (12 1, followed by a reduction to the degrees of 
freedom of the subsystem. The form of the composite 
system (system S and bath B) Hamiltonian is, 

H(t) = H s {t) <g> t B + l s 



H, 



SB, 



(13) 



where Hg 7 Hg and Hgg denote the Hamiltonians of sys- 
tem, environment and the interaction between system 
and environment, respectively. By tracing out the envi- 



ronmental degrees of freedom in Eq. ( 12 1, one can deduce 
the differential equation for the density matrix of subsys- 
tem S. 



dt 



Ps{t) 



-tv B {[H(t),p(t)]}. 



(14) 



Calculation of the dynamics of the reduced system is, 
except for very few simple examples, a demanding task. 
Despite its simple appearance, it is, in fact, often dif- 
ficult to cast the above equation in a form in which 
numerical evaluation is tractable. For Markovian pro- 
cesses one may employ the Lindblad master equation 
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approach which will be described in the next section. 
To obtain kinetic equations within microscopic quantum 
mechanical models one can use a perturbative expansion 
in the system-environment coupling, non-perturbative 
rcsummation techniques, or projection operator tech- 
niques. For a detailed description of common methods 
see Ref. M 

State superposition and entanglement are key- 
ingredients for quantum information processing. Making 
the qubit to perform a specific unitary transformation 
is done by proper tuning of external controls interacting 
with the dynamics of the quantum system. However, via 
the same channels by which one couples to the qubit, as 
well as by additional sources ("the environment") over 
which one has no direct control, noise can enter the sys- 
tem. These unwanted perturbations, in general, lead to 
decoherence (destruction of state-superposition and en- 
tanglement) and/or dissipation (i.e., state relaxation), 
both being detrimental for quantum computation, sec 
Fig.ll 

|1 > — *|0> 




J0> |0>. 

|0>+|1>->|0X0|+|1X1| 



FIG. 3: Relaxation and dephasing (i.e., decoherence) due to 
unwanted environmental interactions within the Bloch sphere 
picture. T\ denotes the relaxation and T% the decoherence 
time. 



2. Models of dissipation and decoherence 

The Lindblad equation is the most general Markovian 
differential equation which is of first order in time and 
which preserves positivity and trace=l for the system's 
density matrix. It can be viewed as a Markovian ex- 
tension of the von Neumann equation to open quantum 
systems by adding a dissipator to the equation. In its 
general formj^l 

ihps = [Hs(t),p 3 ] + D[p s ], Ps (0) = Po, (15) 

with 

N 2 -l , 

D\p s ) = ih [ L ^PsLl~ 

\LlL^ps - ^psL^LA , (16) 



the dimensionless operators L M contained in the dissipa- 
tor describe the different decay and decoherence channels 
of the quantum system which are opened by its interac- 
tion with the environment. The quantities 7 M are effec- 
tive relaxation rates which may be set phenomcnologi- 
cally or be computed on basis of a microscopic model. 
Since the Lindblad structure is the most general of a 
Markovian master equation for p$, it serves as refer- 
ence for Markovian master equations which are derived 
from microscopic models within approximations. Op- 
timal control schemes have been used to optimize the 
dynamics of quant um systems which are described by a 
Lindblad equation! 25 ! 28 ! 32 ! 47 -^ The use of Lindblad op- 
erators with constant 7^ 's is phenomcnological and lacks 
details about the quantum mechanical interaction be- 
tween sub-system and environment. Therefore, control- 
lability of the system is usually poor when this model is 
appropriate. 

Among the elementary microscopical models for a 
system-bath interaction the m ost pr ominent example is 
probably the spin-boson modetf^^. In its basic form, 
a spin ^-particle couples linearly to the oscillator bath 
polarization. The Hamiltonian for bath and system-bath 
interaction, respectively, are usually written as, 

H B = y^hhj h b\b k , 

k 

H SB = S®T,T = hJ29k(h + bty, (17) 

k 

where is the bosonic (creation) annihilation opera- 
tor for mode ojf. and g k is the effective coupling strength 
of the fcth mode to the spin S S {S x , S y , S z }. T de- 
notes the bath polarization. In QIP one focuses mainly 
on the case of weak coupling of the bath to the two level 
system (interpreted as the qubit). For this case pertur- 
bative methods, such as the Born approximation and the 
Bloch-Redfield approach, are be st sui ted to describe the 
reduced dynamics of the system! 46 ! 51 ! jf one j s interested 
in the strong coupling regime, techniques like the polaron 
transformation^! or path-integral approaches [e.g. the 
non-interacting blip approximation (NIBA)] are avail- 
able. For a method which deals with both regimes see 
Ref. In general, the validity of each of the mentioned 
approximation schemes also depends on the bath tem- 
perature and/or on other bath-spectral-d ensity sp ecific 
characteristics (e.g. the cutoff frequency) ! 53 l 54 l 5 3 Opti- 
mal control of a qubit system subjected to a polaron 
transformation and a subsequent approximation by a sec- 
ond order expansion in the tunneling parameter A [which 
is equivalent to the NIBA approximation, see Ref. [SB] 
has been performed in Refs. 24 3JH For longitudinal cou- 
plings, i.e., S = S z , and H$ oc S z analytical solutions 
are available ! 52 * 5 7 I Because control within H$ is restricted 
within these cases due to lack of control with respect to 
orthogonal directions, they are of minor importance for 
QIP applications. 

Another microscopic model which has been employed 
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to take into account the effects of an environment is the 
spin bath. For a review see Ref. [58] fn Ref. [2TJ optimal 
control techniques have been applied in order to obtain 
high-fidelity one- and two-qubit gates in the presence of 
coupling to "environmental" two level systems, which can 
be interpreted as spin-| particles. The Hamiltonian for 
m qubits and N spin-^ particles is of Heisenberg form, 

N rn AT-1 N 

h = u)jS Zii -^2fiiC(t)s Xt i + ^2 ^Ziij s i • s j> 

i—1 2—1 z—1 j>i 

(18) 

where {Si = {S x ,i, S Vt i, S Zi i)} denotes the (pseudo) spin- 
operator and LOi the (pseudo) Zceman splitting for par- 
ticle i. Here it is assumed that it is possible to locally 
apply a control field C (t) via coupling to dipole moments 
p. L . The strength of the Heisenberg exchange interaction 
between the spins is given by 7.^. 



C. State— selective versus state— independent 
optimal control 

When we apply OCT to QIP systems, we often have 
to change our focus from optimization of state-to-state 
transitions (e.g. \ipi) — > \ipf}) to an optimization of 
quantum dynamical mappings, see Fig. [4j This means 
that for quantum computation it is not sufficient to find 
a control field which manages to steer a quantum sys- 
tem starting from a particular initial state to a prede- 
termined final state. This form of control is usually 
termed "state-dependent" . A quantum gate has to per- 
form the corresponding desired transformation O regard- 
less of the initial state. In fact, the initial state of- 
ten is unknown. This form of optimization is usually 
termed "state-independent" . If we are dealing with uni- 
tary time evolution, described by a Schrodinger equation 
4z \ip(t)) = —i/hHs(t) \ip(t)), state-independent opti- 
mization is conveniently implemented by optimizing the 
time propagator U~s(t), with Us(t) = —i/hHs(t)Us(t) 
and Us(0) — 1. Essentially, one minimizes a cost func- 
tional of the form J = \\Us(tf) — 0\\ 2 or similar .1121201 

The task of state-independent optimization is espe- 
cially interesting for noisy quantum gates. In general, 
a superoperator X(t) defines the time evolution of the 
system for the interval [0, t], i.e., 

p s (t) = X(t)p s (0), X(0)=1, (19) 

where ps(t) denotes the subsystem's density matrix at 
time t. The most general form of such an admissi- 
ble superoperator is given in terms of Kraus operators 

k 

* L mn \ v) 1 

PS (t) = J2 K mn(t)ps(0)Kl n (t), 

K mn (t) = «n| PB (0) \n)) 1/2 (m| U{t) \n) , (20) 



(a) State-selective transformation 




(b) State-independent transformation 




FIG. 4: (a) "State-selective" corresponds to a transforma- 
tion of a predetermined initial state (denoted by a red Bloch 
vector) to a particular given final state (blue Bloch vector), 
(b) "State-independent" means that we want to perform a 
desired mapping, irrespective of the initial state of our qubit. 
For unitary operations, as common in the QIP context, this 
corresponds to a rigid rotation of the Bloch sphere. 

where U(t) denotes the unitary time-evolution operator 
of the composite system, pb denotes the density opera- 
tor of the bath. { |n)} is a complete set of bath modes 
so that (n| ps(0) \n') = 5 n , n ' (n\ ps(0) \n'). Given a mi- 
croscopic model, it is, in general, not possible to find 
analytic expressions for the Kraus operators in terms of 
the Hamiltonian of the composite system. In fact, even 
an exact numerical treatment may be intractable. How- 
ever, one can find equations of motion for the superop- 
erator, which can be approximated. One possibility is to 
switch to a Liouville space description .^Optimal control 
schemes which are based upon such a description can be 
found in Ref. M and Ref. M 



III. STATE-SELECTIVE OPTIMAL CONTROL 
OF OPEN QUANTUM SYSTEMS 

Early applications of optimal control to quantum sys- 
tems have been formulated mostly for state-dependent 
cost functionals for closed quantum systems based on 
pure states within the time-dependent Schrodinger equa- 
tion, with applications mostly in quantum chemistry! 61 ! 62 ! 
Then, mixed-state optimal control, formulated within 
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the von Neumann equation and, finally, within opti- 
mum control for open quantum systems has followed. 
State-dependent optimal control has applications in 
many aspects of quantum physics. Originally, it was 
motivated for driving a quantum systems, such as a 
molecule, from an initial state, usually the ground 
state, into a certain final state, for example, a partic- 
ular fragmented state of the molecule. Later, combina- 
tion with coherent control, exploiting quantum interfer- 
ence, has been proposed and ex ecuted in semiconductor 
nanostructures mMMMEWMM 

In this section, we review several cases for state- 
dependent optimal control. Rather than specifying par- 
ticular physical realizations, we keep the presentation 
general and distinguish between Markovian and non 
Markovian quantum systems, i.e., the nature of their 
dissipator. The motivation for this study is the use of 
quantum interference between competing interactions as 
a principle of operation for electronic and electro-optic 
nanoscale devices. Particularly in a solid-state environ- 
ment, electronics- and spin-based quantum interference 
effects are difficult to establish and to maintainP^l One 
of the potential solutions is to steer the quantum sys- 
tems along a suitable quantum trajectory so that one 
eliminates or minimizes the system environment inter- 
action by destructive quantum interference. This natu- 
rally leads to an optimization problem (inverse problem) 
where one seeks optimal control fields which stabilize co- 
herence of a quantum system or maximize induced quan- 
tum interference effects. 

For the remainder of the paper we shall denote the 
quantum subsystem "system" and the reduced subsystem 
density operator ps by p, and Us(t) by U(t), for brevity. 
Furthermore, the subsystem Hamiltonian Eq. (10 1 will 



Direct inversion 



generally be denoted by H(t), except when stated other- 
wise. 



For direct inversion of the Lindblad equation one first 
selects a physically allowed trajectory p(t) which is com- 
patible with a specified initial and final state p(0) and 
p(tf), from whic h a suitable Hamiltonian H(t) is ex- 
tractedpHMnEH 



p(0) ^ p(t f ) 



Hit)- 



(21) 



The main problem lies in the existence and identification 
of such a trajectory. The problem is even more compli- 
cated in open quantum systems than it is for pure co- 
herent dynamics under unitary time-evolutionPS In this 
case, there is a trajectory and a solution to the problem 
if the eigenvalues of p(0) and p(tf) are identical. Un- 
fortunately such a simple criterion cannot be formulated 
for open quantum systems. In fact there are several open 
questions for open quantum systems : How does one de- 
termine or even prove the existence of an allowed trajec- 
tory? Which role does the kinetic equation play on the 
existence? The procedure (21 1 may lead to non-local 



solutions for H(t). Hence, the question arises, what con- 
ditions have to be met in order to derive experimentally 
feasible solution to such inversion problems. Finally, if 
a solution has been identified, is it unique or are there 
equivalent solutions which may be better suited for phys- 
ical realization? Obviously, the difficulties in answering 
these questions increase rapidly with the dimension of 
the Hilbert space and the complexity of the dissipator. 
Nevertheless, some nontrivial and interesting results on 
dissipative two-level systems have been found, where the 
system is described by a Lindblad equation. The reader 
can find a detailed discussion of this topic in Ref. [25] 
Here we give a brief overview to demonstrate possibili- 
ties and difficulties associated with the direct inversion 
strategy using a two-level system. 



A. Markovian kinetic equations 



2. Choice of the trajectory: decoherence free subspace 



The Lindblad equation Eq. (16) captures the dynam- 
ics of a quantum system in the Markovian regime, i.e., on 
a time-scale of the quantum system which is large com- 
pared to the memory-loss time of the environment!^ On 
this time-scale, the damage to coherent dynamics of a 
quantum system caused by its environment partially has 
become irreparable, however, limited reduction of coher- 
ence loss has been shown to be possible, particularly, if 
the effective rates 7^ in Eq. (16 1 feature a dependence 



upon the adjustable control fields. We shall first consider 
the situation of constant 7^'s. In this case, the optimal 
control problem of a dissipative qubit may be solved an- 
alytically by direct inversion, as is shown in the following 
subsection. In the second part of this section we briefly 
discuss the case of control-field dependent effective rates 
7 M which allow for greater control potential. 



In many OCT problems the decoherence free subspace 
(DFS) plays a central role. Using the kinetic equation 
Eq. ([l5t , the la tter is defined as the set of states pdf 



D[p DF ] = 0. 



(22) 



Depending on the nature of the dissipator, Eq. (22) de 



fines a subspace of density operators, which interesting 
for OCT because within the DFS the system dynam- 
ics is completely coherent. In many systems, the DFS 
is constructed by dynamic decoupling processes, such as 
an app lication of control pulses known as "bang-bang" 
control. ^ 7 * 78 * 79 * 80 ! To study such methods, the spin-boson 
model again is well suited, since it explicitly displays 
the influence of the external control on the system- 
environment interaction If a state pdf exists and is 
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known and if the system allows complete control, the op- 
timal trajectory is given by, 



p(0) -> PDF -> p(t f ), 



(23) 



whereby the switching into and out of po f has to be exe- 
cuted rapidly. Using inversion formulas one can evaluate 
Eq. (23 1 to obtain an optimal control Hamiltonian. We 



remark that in such cases it is sufficient to consider the 
inversion of the von Neumann equation because one can 
minimize environment-induced dissipati on b y "instanta- 
neous" switching in Eq. (23 1 in principle. 123 Recently we 



have extended the concept of the DFS from states to evo- 
lution superoperators. This strategy can be applied for 
both state-dependent and state-independent OCTP^l 



3. Two-level system 

The kinetic equation for the density matrix p(t) (quan- 
tum trajectory) is given by Eq. (15 1. Considering the in- 
verse problem, we begin with the selection of a quantum 
trajectory p(t) for a specified time interval t € [0, t/}. We 
set, 



P(t) = 



pu(t) a(t)+ib(t) 
a{t)-ib{t) l-pn(t) 



(24) 



Here pn(t), a(t), b(t) are real valued functions. To solve 
the inversion problem we put the dissipation part on the 



left hand side of Eq. (15 I and subtract it from p(t). In 
particular we set, 



p u (t) = Pu (t) - ~(D[p(t)]) n , 
in 



a(t) = a(t) - -lm(D[p(t)]) 12 , 



b(t) = b(t) + -Re(D[p(i)]) 12 . 



Insertion of Eq. (24 1 into Eq. (15) leads to, 



ha — bu + w(l — 2pn), 



-hb = 



v(l-2 Pll ). 



(25) 
(26) 
(27) 

(28) 
(29) 



Here we set u = Hu — H22 and v = Rc(iii2), w = 
Im(i? 12 ) as our unknowns. Note that pn(t), a(t) and 
b(t) in Eq. (24 1 depend on each other via the condition, 



aa - 



bb: 



P11 



(l-2pii), 



(30) 



which follows from Eq. ( 15 I and links the variables pn(t), 
a(t) and b(t). This relation must hold for any allowed 
trajectory of the dissipative quantum system, indepen- 
dent of the structure of D[p(t)]. We remark that for a 



dissipation-less system, Eq. ( 30 I represents conservation 
of purity, i.e., constant length of the Bloch vector. If the 
dissipation is described by fixed rates, this relation is in- 
dependent of the control, which means that there is no 
Hamiltonian which allows independent control of all ma- 
trix elements of the density matrix. Eq. (28), Eq. (29) 
and Eq. ( 30 1 are the basis for the solution of the in- 
version problem. One can see that Eq. (30 1 defines a 



condition which in simple cases is a differential equation. 
Depending on the dissipator, more complicated integro- 
diffcrcntial equations may occur. 



4- Example 



We consider a simple model, given by the Hamiltonian, 



H(t) = e{t)a x , 



(31) 



where the control e(t) is a real- valued function (here H a 
in Eq. (10 1 is chosen zero). For the Lindblad operators 
we choose, L\ = ^/7i|0)(l|, L2 — \/72|l)(0|. For simplic- 
ity we set 71 = 72 = 7. In this case, there is restricted 
control over the system only, i.e., the Bloch vector can 
be rotated around the x-axis only (see Fig. JTJ. We con- 
sider the case where we seek to manipulate the popula- 
tion pn(t). By inversion of the Lindblad equation one 
obtains, 



e{t) = h 
Here b{t) is given by, 

b(t) = ( b(0) 2 



b{t) + 4jb(t) 
-l + 2pu(t)' 



(32) 



[pn(0 + 87Pii(0-47]}^') 5 , 



(33) 



as follows from Eq. ([30]) . We require a real Hamiltonian, 
which leads to a(t) — a(0)e -47 *. So one has the choice 
of pn(t) as only remaining freedom. The other variable 
b(t) and the control e(t) are deduced quantities. For a 
specific example, we wish to maintain Rabi oscillations 
in presence of dissipation and set, 



Pll (t) = (1 - 2A) cos 2 (ftt) + A, 



(34) 



where A > is a constant. Induction and maintenance 
of Rabi oscillations in a realization of a two-level system 
is generally viewed as a test for its qubit potential. 
The field for the special case 7 = is, 



e{t) = nn 



y/2(l-2A) sin(2ftt) 
^8bl + (1 - 2A) 2 [l - cos(4fii)] ' 



(35) 



For 6(0) = bo = this expression reduces to a constant 
field e = Ml. The expression for 7 7^ is also available in 
analytical form, but is a quite lengthy expression. Fig. [5] 
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shows a numerical example. Part (a) shows the field for 
Eq. ([35) (dotted line) and the field with 7 ^ (solid 
line). Part (b) shows Pn(t), when the respective fields 
are used to drive the system. As the figure shows, a com- 
plete restoration of the prescribed trajectory, Eq. (34), is 



possible. Further inspection of the field shows, however, 
that this complete restoration is possible only for a lim- 
ited time; for how long , depends on the parameters A, 
bo, and the damping constant 7. One can compute this 
time numerically using Eq. ( 32 ) . 



Dissipative TV-level systems have also been modeled 
fully numerically within the Lindblad equation account- 
ing for population and polarization decay, based on con- 
stant decay ratesP^l The problem addressed was popula- 
tion transfer from a non-degenerate stable ground state 
to an unstable target state at tf, using weak electric 
fields whenever possible. Work concentrated on a ladder- 
type iV-level system for which an electric field can induce 
dipole transitions between adjacent energy levels, as typ- 
ical for systems with inversion symmetry, and schemes 
as used in stimulated-Raman-adiabatic-passage (STI- 
RAP) experiments. For all systems studied, i.e., two-, 
three-, and four-level systems, it was found that the 
weak-dissipation limit which is relevant for atomic and 
many molecular systems, poses no serious threat to suc- 
cess. However, as dissipative effects increase in strength, 
so do the electric fields which are necessary for reach- 
ing the selected target state. In addition, their onset is 
delayed closer and closer to target time. Clearly, with 
increasing complexity of the system, such as the number 
of unstable levels and decay channels, the degree of suc- 
cess decreases. Since purity decay cannot be controlled 
directly by the external control for constant Lindblad 
decay rates, "last-minute transfer" from a stable state 
remains to be the only solution for a complete transfer 
into an unstable target state when there is no control 
over decay rates. 



5. State-dependent optimization within the spin-boson 
model 



Dissipative two-level systems naturally are treated 
within the spin-boson model introduced in Sec. |II B 2| 
In spite of it's simplicity, it allows coverage of a large 
spectrum of physical effects by proper mapping of more 
complex quantum systems and appropriate choice for the 
spectral function. Unfortunately analytic solutions are 
not available, in general. In Ref. 24 the Bloch-Redfield 
approach was used to derive Markovian kinetic equa- 
tions for the spin-boson model in the strong electron- 
boson coupling limit. Using the polaron transforma- 
tion, kinetic equations for the Bloch vector with an ef- 
fective coupling within the spin system are obtained. 
This coupling is renormalized by the spin-boson inter- 
action and displays a retarded control-field dependence 
which arises from interference between the system-bath 
and system-control field interaction. Several physical 



situations of spin flips have been investigated numeri- 
cally to demonstrate quantum-interference-based opti- 
mal control of this model for an open quantum system. 
Using simple analytical forms for the control fields it was 
shown at the example of this model how external control 
of quantum interference can be used to control the effec- 
tive system-bath interaction for minimization or maxi- 
mization of the coherence loss. In the following section, 
we outline the generalization to non-Markovian kinetic 
equations. 



B. Non— Markovian kinetic equation 

The study of control-field dependent system-bath in- 
teractions has recently been extended to a study of op- 
timal control of qubit realizations with non-Markovian 
dynamics which captures and clearly demonstrates the 
role and potential of quantum interference effect s in the 
control of effective system-bath interaction! 47 ! 81 ! The ba- 
sic idea is that, when the system-bath interaction is ei- 
ther treated theoretically or can be addressed experi- 
mentally on a quantum-mechanical level, quantum in- 
terference effects can be utilized to control the effective 
coupling strength.^ Needless to say, this requires micro- 
scopic models for open quantum systems, on the theo- 
retical side, and poses considerable challenges for experi- 
mentalists regarding precision, strength, and time-scales 
for the control to be administered. 

It appears that, until recently, classical and quantum 
mechanics applications of optimal control have concerned 
themselves with mostly, if not exclusively, Markovian sys- 
tems, i.e., systems for which knowledge of the state of the 
system at any given time is sufficient to uniquely specify 
their past and future. However, when one studies the 
dynamics of a subsystem, non-Markovian kinetic equa- 
tions arise naturally when the degrees of freedom of the 
environment are integrated out. This has become of par- 
ticular importance to the study and control of quantum 
subsystems ("realizations of quantum systems") in the 
context of implementation of quantum algorithms into 
real systems. If one can address and control a system in 
its quantum regime, quantum interference leads to new 
pathways ("control knobs") for steering the system and 
for controlling dissipation. Put simply, in the classical 
regime only the diagonal matrix elements of the den- 
sity matrix (in a suitable basis) can be manipulated, 
while in the quantum regime all matrix elements are 
available for manipulation. 68 Simple decay rates become 
time- and control-dependent greatly enhancing control 
over the system. 

Within quantum mechanics, the emergence of non- 
locality with respect to time is most directly seen within 
the projection operator method whereby the bath (envi- 
ronment) degrees of freedom are projected out formally 
by a suitable projector Q, such that, in the simplest case 
when using the identity representation 1 = P + Q, one 
obtains two coupled sets of kinetic equations of first order 
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(a) 



(b) 




FIG. 5: (a) The control fields versus time. Dashed line: solution in absence of dissipation, given by Eq. (35 1. Red solid line: 
control field which corrects for dissipation, (b) Trajectory pn(t) versus time. Dashed line: uncorrected, damped trajectory, 
obtained with the dissipation-less solution. Red, solid line: corrected trajectory as prescribed by Eq. ( |34[ ). Parameters: 
7/fi = 0.0071. A = 0.3, b = 0.2. 



in time, one each for Pp and one for Qp = (1 — P)p. For- 
mally integrating the kinetic equation for Qp = (1 — P)p 
and inserting the result into the one for Pp, the latter 
becomes a non-Markovian differential equation for PpF§* 
Similarly, non-Markovian equations are obtained readily 
within the density matrix approach when truncating the 
BBGKY-type hierarchy of higher correlation functions! 8 ^ 
In many cases, non-Markovian kinetic equations can be 
approximated or even exactly b e repla ced by an enlarged 
number of Markovian equations! 46 * 84 ! 

We consider for the quantum subsyste m a no n- 
Markovian time-evolution of the general formj^lS51SSI 



p(t)= dt'K(t,t';s,p), for p(0) = p . (36) 
Jo 

The integral kernel K{t,t'\ e, p) is given by the following 
form. It depends on two times: the current time t and a 
time t' accounting for the past t' < t. Furthermore, the 
kernel functionally depends on the control field s(t"), for 
t" < t such that causality is fulfilled, as well as on p(t') for 
t' < t. In general, it is a non-linear super-operator which 
maps p(t'), t' < t onto a linear operator of trace zero. 
The latter is needed to ensure trace preservation for p(t) . 
Moreover, the memory kernel K{t,t'\ e, p) must preserve 
positivity of p(t) at any time < t < tf . It is assumed 
that Eq. (36 1 is integrable, i.e., there exists at least one 



solution to any given control field e{t), t <E [0,i/] which 
itself is square-integrable and bounded over the interval 
[0, tt]. In other words, the constraint is holonomic. These 
conditions are equivalent to the assumption of the exis- 
tence of a Kraus representation for the time-evolution 
operator denned by Eq. ([36 

In what follows we shall review and extend a re- 
cent generalization of optimal control problems to non- 
Markovian constraints! 8 ^ For didactic reasons we present 
this approach pointing out analogies to classical mechan- 
ics. Referring to Sec. IB we make the following assign- 



ments. The state vector x is interpreted as the den- 
sity operator of the subsystem p(t) and the scalar prod- 
uct (x,y) between two vectors x and y is interpreted 
as the Froboenius product between operators X and Y , 
Tr{Xty}P 

The objective is formulated by means of a cost func- 
tional for which we choose the general form, 

J(e,t f ) = Tr {$ (p(t f )),p(t f )} 



Tr {<f>(p(t),e(t),p(t),i(t),t)} df.(37) 



The time derivatives ("generalized velocities") p(t) and 
s(t) are included to preserve the analogy to the formalism 
of classical mechanics, as well as to allow for conditions on 
the rate of change of the state of the system and a means 
for suppressing unphysically rapid variations of the con- 
trol field in the cost functional explicitly. The real-valued 
functionals <b (p(tf), p(t f )) and <b(p(t),e(t), p(t),i(t),t) 
are bounded from below and continuously diffcrentiablc 
with respect to their arguments. They account for the 
specific physical objective at target time tf and interme- 
diate times t € [0, tf). The target time itself, in general, 
is variable in the optimization process P^l The dependence 
of $ on e(t) and e(t) allows the implementation of addi- 
tional constraints on the control, such as shape, duration, 
rate of change, or intensity. This may be essential to ar- 
rive at solutions which are experimentally feasible. The 
(indirect) dependence of J on p is included mostly for 
analogy to classical mechanics. In principle, specification 
of the rate of change of p may be useful. For example, 
state trapping can be treated by implementation of the 
condition p(t) = 0, ( e [0,i/]. However, for a quantum 
subsystem the state of the system is fully determined by 
p and its kinetic equation is of first order in time. In 
contrast, for classical mechanics the state of the system 
is specified by generalized coordinates and velocities and 
the kinetic equations for the coordinates are of second 
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order in time. Hence, simultaneous specification of p and 
p may over-determine the system of equations. 

An optimum control field is one which minimizes the 
cost functional under the constraint that pit) obeys the 
kinetic equation. Thus the control field e(t) represents 
independent variables and the density matrix elements 



play the role of dependent variables. In the following we 
will formulate the necessary conditions using an indirect 
method which provides the gradient of the cost functional 
with respect to control field and target time. 

The total differential of the cost functional is given by 



dJ(s,tf) 




dp(t f ) 



6$o 
5p 



dp(t f ) 



, S<$> 5<$> 

9{p,E,p,e,t) - jrp - jr£ 



5p{t) - 



5<S>\ 



dt \Sp J 



Spit) 




(38) 



Here the variation 5 pit) is dependent upon the variation 
of e(t'), for t' < t via the kinetic equation Eq. (36 1, e = 



and an extended cost functional is constructed, 



fandp = f. 

Since it is assumed that the constraint is holonomic, 
one may use either the general method of Lagrangean 
multipliers or Hamilton's variation principle to derive 
the necessary conditions for an extremum of the cost 
functional P^l In the first derivation given below, the de- 
pendence of p(t) on e(t) is incorporated by a Lagrangean 
multiplier which, in this context, is termed co-state or 
adjoint state. The variation is made with respect to 
the generalized coordinates p and e and the associated 
velocities p and e. The second, equivalent formulation 
offered here is based on Hamilton's variational princi- 
ple which uses both e(t) and pit) and their canonically 
conjugated variables ( "canonical momenta" ) as variation 
parameters. In optimization theory, the latter method is 
known as Pontryagin's minimum principle.^ 



J = J(M/) = J(e,t f ) 



dtTr{\(t) 



(39) 



dt'K(t,t';e,p) - p(t) 



}• 



A(i) is a linear operator in the Hilbert space of the system 
but it does not have the properties of a density opera- 
tor. The components of X(t) are chosen such that the 
variation with respect to the dependent variables van- 
ishes. Note there are exactly as many constraints as 
there are density matrix elements. The kinetic equa- 
tion for p{t) results from the condition of stationarity 
of J with respect to variation of A. Implementing causal- 
ity of the kernel, i.e., that K(t,t';e,p) depends on e(t") 
only for t" < t, using Sp(tf) — dp(tf) — p(tf)dtf and 
Se(tf) = de(tf)—e(tf)dtf, the total differential of J gives, 
after integration by parts, 



1. Minimality conditions via the Lagrangean multiplier 
technique 

The Lagrangean multiplier method is a powerful tool 
for incorporation of general constraints, holonomic or 
non-holonomic, into an extremum problem.^ In order 
to establish a tractable relation between the variation 
of the control e(t') and the density operator p(t) a La- 
grangean multiplier A(t) is introduced to implement the 
kinetic equations into the variation of the cost functional. 
For each constraint a Lagrangean multiplier is introduced 



dJ(e,t f ) = dJ(e,t f )-Tr{X(t f )dp(t f )-X(t f )p(tf)dt f } 

+ dt dt'eit-t')Tr 
Jo Jo 

SK(t,t';e,p) 



A(t) 



dp 



Spit') 



S(t+ - f )A(0 
(40) 

5e{t") 



Variation with respect to p, s, and tf, respectively, gives 
the following necessary conditions, 



jt \ - u 



W)-^ (M ' £ ' P) 



Sp 



T P 



Spit) 



(41) 
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SJ(e,t f ) 
8e(t") 



1 dt 1 dt'e(t - t')Q(t - t")Tr { Af ' ) 



6K(t,t';e,p) 
Se(t") 



Tr 



d <5$ 

dt Si 



= 0, (42) 



r 



6J(e,t f ) 



St 



and 



<5p 



6$ 

Hi 



= Tr 




t=o 




(45) 



We conclude this formulation with a few comments: 
(i) The optimality problem of dynamic control of a 
quantum system has been reformulated as a coupled set 
of two initial-value problems embedded in an iterative 
scheme: For given control and target time tf the initial- 
value problem of finding p(t) for given p(0) is solved. 
Then the co-state is determined from the initial value 
problem Eq. ( 41 1 starting at time 1 1 and going back to 
time zero. Finally, the gradients of the cost functional 
J with respect to control and target time are computed 
to aid the approach towards a minimum of J using a 
suitable numerical procedure. 



(ii) Here we have used a continuum notation. Numer- 
ical implementations, however, will use a time grid and 
care must be taken to use a consistent grid for density 
operator, co-state, and the gradients to ensure optimal 
numerical efficiency. 

(iii) In the relations above we have used step functions 
Q(t) which ensure causality for clarityonly. In fact, phys- 
ical kernels will ensure causality on their own. 

(iv) When the cost functional is chosen to be indepen- 
dent of the "velocities" p(t) and i(t), the Euler-Lagrange 
equations reduce to — 0, where stands for the 
components of control and density operator. 



2. Minimality conditions via Hamilton's variation "principle 
(Pontryagm's principle) 

Hamilton's variation principle applied to the action, 
whereby the integrand is interpreted as the Legendre- 
transformcd Lagrange function, yields the canonical 
equations of motion of a classical mechanical system.^ 
The expression for J, Eq.(39l, lends itself to this proce- 
dure if one rewrites it as, 



.Hp. :. A. /-./,! = ./ - / ' dtp(t) ( ~ - i{t) } = Tr j <!>„(/,. /,./,- 1 } + / ,//Tv (//(:. ,,. A. / ) - Af / / i - P { / )A( / ! }. ( 4(, i 



where, 



de f 

H{e, p, X, t) = Tr <j $(p(t), p(t), e(t), i(t), t) + p(t) — + X(t) J dt'K(t, t'; e, p) 



Written in this form, \(t) and p(t) play the role of and e(t) and "canonical momenta" X(t) and p(t). After 
the canonical momenta, respectively, associated with the integration by parts, one obtains the following necessary 



variables p(t) and e(t). Variation is carried out indepen- 
dently with respect to the "generalized coordinates" p(t) 



conditions for an extrcmum of J: 



dH(e,p,X,t) dH(e,p,X,t) de 

Pv-> = xV7T\ ' Wltn P(°> = Poi £ ( t ) = 



dX(t) 



dp{t) dt ' 



(47) 



x { t) = - r dt> dH ^y^ { t> - 1) , with x(t f) = w - 



dp(t) 



S P (t) 



(48) 
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dJ 



dJ 



de(t>) de(t>) 



= P(t') + 



with p(t f ) = p(0) = 0, 



(49) 



5$ 

Hi 



tf 



Hi 



= 0. 



t=o 



(50) 



r 



These equations may be interpreted as "canonical 
equations of motion" (Hamilton's equations of motion) 
generalized to systems with a non-Markovian depen- 
dence on "generalized coordinates". Eqs. ETl) and ((481, 



respectively, give the kinetic equations for the density 
operator and co-state, the latter playing the role of the 
canonical momentum of p. Eq. (49) gives an implicit 
relation for the optimal control field in terms of the so- 
lutions p{t) and X(t), as well as the gradient of the cost 
functional J with respect to variation of e(t). Inserting 
the definition of H into Eqs. (|47|, pSl, and (W91, respec- 



tively, gives a system of optimality conditions which is 
equivalent to Eq. (p6l), Eq. (|4lj), Eq. (1431), and Eq. ((42 1. 



Kernels which arc linear in the density operator and 
fixed target time represent a specially important case, 

K(t, t'e, p) = k(t, tf, e)p{t') + d(t, t', e). 

If, for example, we consider driving of the subsystem 
along a desired trajectory p (t), with p o (0) — p(Q) = p a 



and p (tf) = Pf for fixed tf, the following cost functional, 



a(t) \e\ {t)dt, 



(51) 



is useful. Here = Ti^AA^} is the Froboenius norm 
and a(t), w\, and u>2, with w\ + u>2 — 1 arc real- valued 
weight factors to specify driving (w\ — 1) and trapping 
(w 2 = 1). a(t) is real- valued and can be used to taylor 
the control pulse shape by penalizing high intensity. In 
case of certain linear control problems the third term is 
necessary to make the problem regular. 10 

For this case the optimality conditions are, 



A(i') = 



dt\(t)k(t, t', e) - w 2 (p(t') ~ Po {t')), \{t f ) = Wl {p{t f ) - Po ), 



(52) 



Se(t") 



1 dt ( * dt'Q(t - £')e(t' - <")Tr { \{t) 
o Jo 



6k(t,t';e) 
Se(t") 



P(t') 



5d(t,t';e) 



Se(t") 



+ a(t")e(t"). 



(53) 



r 



3. Application 

In an effort to demonstrate optimal control by quan- 
tum interference for a non-Makovian quantum system, 
the two-level spin-boson model with a z coupling to both 
bosons (phonons) and control field and c onstan t a x cou- 
pling between the two levels was employed 12S1SS1 Examples 
for physical realizations of this model are shown in Fig. 

m 

The polaron-transformcd Hamiltonian may be writ- 
tenP 



Htot = Hs(t) + H B + H ir 



(54) 



Hs(t) = — § (eo + e {t)) a z is the new Hamilton operator 



of the driven qubit, and 

1 

2 



H\„ t — 



(55) 



gives the new interaction which is now proportional to A, 
renormalized by the electron-phonon interaction. Here, 
(7 + = [a x + i(T y )/2 and er_ = (<j x — ia y )/2 and fl — 
£k = (qoCi/ftrriiUjf) pi. 
A non-Markovian kinetic equation is readily obtained 
within the Nakajima-Zwanzig projection-operator 
method! 46 Applied to the present model, the kinetic 
equations for the Bloch vector R up to second order in 
A and arbitrary spin-phonon coupling strength take the 
formpSl 

R(t) = M e (t)TL+ f dt'K(t,t / )R(t')+T(t), (56) 
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Driving to State (0,0,1) and Trapping 

Gradient Method 
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-e„/2 



B(t) 



FIG. 6: Two realizations of a dissipative qubit: (a) bias- 
controlled location of an electron in a semiconductor double 
dot; (b) spin 1/2 orientation controlled by a magnetic field. 



where, 



M e (t) = 



with the kernel, 



(e + e(t)) 

(e + e(t)) 




(57) 



K(t,t') = A 2 e-^*-*') cos Qi(t-t') 


\ | -1 

-cos(/(M')) 

and F(t) = (0,0,-r o (t)), with, 



(58) 



T (t) = A 2 / dt'e-^-^ sin(/(<, 0) mn{Qi(t - f )), 
Jo 

(59) 



f(t,t')=s (t-t') + / dt"s(t") 



and 



An Ohmic bath with phonon cut-off frequency lj c is cho- 
senPsl Using the cost functional Eq. (51 1 containing two 
real p ositiv e weight factors ittj, several objectives were 
posed: 38 86 "Instantaneous" population transfer and sub- 
sequent trapping (wi — u>2 — 1/2) is illustrated in Fig. [7] 
with corresponding control fields given in Fig. [8] Model 
parameters are given in the caption. Oscillations seen for 
the control-free case (red line in Fig. |7| are a signature 
of non-Markovian behavior: the system is released in its 
ground state (in thermal equilibrium with its bath) but 
"does not know it " . Only after probing its environment 
it settles into this state. 

The example of population transfer at target time tf 
(w\ — 1,W2 = 0) is illustrated in Fig. [9] with corre- 
sponding control fields given in Fig. [lOj Again, model 
parameters are given in the caption. The "last-minute 
switching" strategy is clearly evident. 




E=0 

"optimal" field 



10 20 30 40 50 60 70 80 

Time (arb. units) 



FIG. 7: Driving a qubit from its ground state into the 
"up" state and trapping: red dashed line: ground state (con- 
trol field=0); solid green line: step pulse (optimized con- 
stant field); black solid line: indirect method. Parameters: 
e = -1,A = 0.75, u c = 4, T = 0.2, a = 0.216. From Ref.l86l 

Driving to State (0,0,1) and Trapping 

Gradient Method 




■ "optimal field" 
E=2.75 



Time (arb. units) 

FIG. 8: Control field for driving a qubit from its ground state 
into the "up" state and trapping: solid black line: indirect 
method; dotted red line: step pulse (optimized constant field). 
From Ref. ESI 



The third task is a flipping of the Bloch vector from 
a stable state into another. Results are illustrated in 
Fig. [TT] and Fig. [12] Detailed analysis of this case shows 
that the control decisively adjusts the effective coupling 
to minimize dissipative losses. In some cases multiple 
(rather than single) switching has been found to lead to 
best results.^ 

Finally, we consider a weak coupling situation with 
e = -2, A = 0.25, T) = 0.45, temperature T = (3~ x = 
0.5, and w c = 2. In thermal equilibrium the Bloch vec- 
tor is R = (0, 0, —0.96). The task is to flip the spin into 
state R = (0, 0, 1) and to trap it there. In this case, 
the shortest possible flipping time is of the same order 
as tf. We consider three cases: driving and trapping 
W2 = 1/2 in Eq. (51), pure driving W\ = l,u>2 = 



Wi 

using the conjugate gradient method, and a genetic code 



1G 
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Gradient Method 
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FIG. 9: Optimized control for driving a qubit from its ground 
state into the "up" state at given target time. From Ref. ESI 



FIG. 12: Flipping the Bloch vector from state (1,0,0) into 
(-1,0,0). e = -1,A = 0.25, lu c = 0.5, T = 0.5, a = 0.25. 
From Ref. EH 
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FIG. 10: Driving a qubit from its ground state into the "up" 
state at given target time tf = 80. (Intensity minimization), 
e = —1, A = 0.75, lu c = 4, T = 0.2, a = 0.216. From Ref. ESI 
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FIG. 11: Flipping the Bloch vector from state (1,0,0) into 
(-1,0,0). e = -1,A = 0.25, uj c = 0.5, T = 0.5, a = 0.25. 
From Ref. \M 



Driving into State (0,0,1) 

Gradient Method - Small Coupling 
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e(0 (driving and trapping) 

E(t) (driving) 

■■■■ t(t) (20— p genetic code — trapping) 
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FIG. 13: Driving of the spin-boson system from thermal 
equilibrium at Zi = —0.96 to z = — 1 (target state) and sub- 
sequent trapping. e — —2, A = 0.25, r\ = 0.45, temperature 
T = /T 1 = 0.5, and lo c = 2. 



for driving and trapping w\ = = 1/2, whereby the 
control is represented by a 20-parameter spline function 
over the interval [0, tf]. Results for the z-component of 
the Bloch vector are shown in Fig. |13| w hile correspond- 
ing control fields are given in Fig. |14| It is seen that 
quite different control field solutions provide similar re- 
sults. Fig. 14 shows r o (t) for the three different solutions, 
clearly demonstrating the influence of the control on the 
effective system-bath coupling. 
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Driving to State (0,0,1) and Trapping 

Gradient Method - Weak Coupling 
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Time (arb. units) 

FIG. 14: Selected optimal control fields e for driving the 
spin-boson system from thermal equilibrium at Zi = —0.96 
to z = — 1 (target state) and subsequent trapping. e = — 2, 
A = 0.25, n = 0.45, temperature T = = 0.5, and lo c = 2. 

Driving to State (0,0,1) and Trapping 

Gradient Method - Weak Coupling 
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FIG. 15: Control of the inhomogeneous part of the kinetic 
equations Eq. ( 56 1 via optimal control fields e for driving of 



spin-boson system from thermal equilibrium at Zi = —0.96 to 
z = — 1 (target state) and subsequent trapping. 



C. Application to electron spin in quantum dots 

Among the proposed physical implementations of a 
qubit t he m ost prominent are based on superconducting 
devices quantum dotsj^ion trapsj^ nuclear spins in 
molecules®! and optical systems.^ Because of their po- 
tential scalability, solid state architectures seem promis- 
ing candidates to build quantum information processing 
devices. 



Here we review optimal control of the spin dynamics 
of an excess electron in a semiconductor quantum dot 
within the spin-boson model, see Sec. |IIB"2| and Ref. [27] 

The electron, as spin-| particle, provides a natural 
two level system. Trapping single electrons by means 
of semiconductor quantum dots enables one to use this 
quantum two level system as qubit. The spin directions 
up (|1)) and down (|0)) with respect to an external 
magnetic field represent the computational basis states 
of the qubit. This implementation has first been pro- 
posed by Loss and DiVincenzoPJ Quantum dots can be 
realized, for example, by means of surface gates on top 
of a GaAs/AlGaAs heterostructure which holds a two 
dimensional electron gas. Controlling and monitoring 
the number of conducting electrons in each dot is pos- 
sible by means of well-established experimental meth- 
ods!^ In a system consisting of two neighboring quan- 
tum dots, each populated by one excess electron, ex- 
change interaction results in a Heisenberg-likc Hamil- 

(12) — * — * 

tonian, H s = J(t)Si ■ S2, if the dots are coupled 
via a tunable tunneling barrier!^ Two-qubit arrays of 
quantum dots are realized by extending heterostructures 
as described above with additional gate electrodes, thus 
defining an appropriate electric potential to trap several 
electrons at different sitesP^l 

In this section, we first define the Hamilton operators 
for the double quantum dot, the environment, and the 
interactions between spin and bath. To describe the dy- 
namics of electron spins in the double dot, a Mark ovian 
quantum master equation approach is usedP^EIES] 

We examine two conduction electrons, each sitting in 
its own quantum dot, where each is described by a Hamil- 
tonian of the form, 



= -9*^-S z B^{t) = - 9 -^ B B^{t)a 



2m_ 



i = 1,2 



(60) 
(61) 



g* denotes the gyromagnetic ratio which depends, as well 
as the effective mass m*, on the types of semiconductors 
used to fabricate the double-dot system. Eq. (60) de- 



scribes the interaction of the ith electron spin with an 
external magnetic field applied in the z direction. Be- 
side B^z\t), which is a control field that can be used 
to adjust the Zeeman splitting associated with the elec- 
tron spin in quantum dot i, one can, in principle, apply 
nonzero x and y components to perform rotations of the 
spin around other axes. 

In spin-quantum-dot systems, the main cause for de- 
phasing arises from charge fluctuations in the vicinity of 
the q uantum dots , phonons, and interaction with nuclear 
spins )2Al g5 | 96 | 97 | 98 ] p or double-dot systems, modeling the 
environment can be achieved by coupling uncorrelated 
baths of harmonic oscillators to each of the spins, 

H B ^=J2^M ] ^\i=l,2, (62) 

k 
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where is the bosonic annihilation [creation] oper- 

ator for the mode with frequency ui k . We describe 
the interaction of the spins with the baths according to 
Sec. |TTB"2l 



11 SB ~~ /t0 z 1 ' 



EOO 

A' 



(63) 
(64) 



4 12) w 



The Hciscnbcrg type interaction, 
J{t)a^ ■ &( 2 \ is needed to produce entanglement 
and conditional operations!^ (a denotes a vector 
containing the x,y and z Pauli matrices.) In the 
interaction picture with respect to Hg + Hb (operators 
denoted by a tilde), the master equation in Born-Markov 
approximation for the present system-bath interaction is 
of the formpD 



Ps(t) 



dt 

~hL dt ' tTR { 



H SR (t), 



(65) 



When evaluating the master equation, one encounters 
correlation functions of the form. 



(66) 



Jf W(t)f = tiR {f W(t)f (i) (i')pii(0)} 

By choosing an Ohmic spectral densityp^^ 



E 



{<£...} -> J dw {J &)...}, 



J(w) — ► ^we - ^, 



(67) 



the correlation functions can be calculated analytically. 
lo c is a cutoff frequency, which depends on the physical 
properties of the dephasing process, and r\ is a parame- 
ter which describes the effective coupling strength of the 
bosons to the qubit. For a bath in thermal equilibrium 
we get, 



fW(f)fW(t' 



2 '/ 



r h 2 irf3 2 
1 + icj c (t - t') 



1 + 



1 - iw c (f - £') 



hu>c/3 



huj c [3 



(68) 



where ?// is the derivative of the digamma function. We 
choose rj — 0.8 x 10~ 13 meVs, (3=1/ (kg 50 mK) and 
lu c = 5 meV. 

As an example, we try to steer the double-spin system 
in the maximally entangled Bell state starting from 

the initial state \ipi), 



0' 

10 







(69) 



where, 



v/2 



(|1)®|0)±|0)®|1» 



V2 



(0,1, ±1,0)' . (70) 



A proper choice for the cost functional, reflecting the 
objective given above, is, 



JM = 

with 



\ps(tf) 

Ml'-: 



l^+x^+il 

tr{^} , 



(71) 
(72) 



where J denotes the cost functional [to be distinguished 
from the Heisenberg-coupling J(t)] and e the control 
field. We parametrize the control field by e(t) = J(t) = 

. 9 (i)£ sin(wi + <?!>o)e~ 7(t ~ to)2 , with {E ,u, <Ao,7,*o} be- 
ing free parameters to be optimized. The function g(t) 
provides a vanishing control field for t — 0, as well as 
smooth increase of s(t) for t > 0. As optimization pro- 
cedure we choose a constrained, parallelized differential 
evolution algorithm with 230 individuals and 2000 gen- 
erations.^ The results are given in Fig. 16 
The desired final entangled state \ip ^) 
ized with high accuracy (»7[e*] ~ 10~ 7 ). As can be 
seen in Fig. 16 d), the differential evolution algorithm 



and Tab. |I| 
can be real- 



converges to a control field with large negative constant 
value (J sa —1 meV), which corresponds to the max- 
imal allowed magnitude of the Heisenberg qubit-qubit 
coupling for the present double-quantum-dot system. 
Qubit-qubit couplings of several 100 /z eV have been re- 
ported in Ref. [511 A large negative value of J(t) makes 
the desired entangled state to the approximate non- 
degenerate ground-state of the system. States with an 
accumulated relative phase with respect to i-e., 
\ip) = l/\/2(|10) + e^ j01>) , become energetically well 
separated from \ip + ) and, hence, transitions to these are 
suppressed. From a different point of view, decoherence 
helps to relax the system from into the new ground 
state. The stronger the environmental coupling the faster 
the system is able to relax. By choosing appropriate 
coupling constants rj, one can, in analogy to classical me- 
chanics, encounter underdamped and critically damped 
regimes, see Ref. |27l 



E /(huj sc ) 


Ul/uJsc 


4>o 




toOJsc 


-0.99 


0.013 


1.34 


0.0 


10.71 



TABLE I: Optimal control-field parameters obtained by the 
differential evolution algorithm, where hu sc = 1 meV. 



D. Control strategies - summary 

Basically all control strategies which have emerged 
from recent work may be classified in the following way: 

(i) 7r-flip control: In cases where pure dephasing occurs 
on a shorter time-scale, such as in SQUID-based qubits 
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FIG. 16: (a,b,c) Density matrix elements {Re [P22] , Re [P33]} , {Im [P23] , Im [P32]} , Re [P23] for the system subjected to the 
optimal control field. t sc = uj sc t, where hui ac = 1 meV. (d) Best solutions after n generations. Black (thin) dashed: n — 2, 
black (thin) dotdashed: n = 13, black (thin) solid: n = 30, red (thick) dashed: n — 70, red (thick) dotdashed: n = 500, 
red (thick) solid: n = 2000. (e) Value of the cost functional for the best solution of each generation. 



or spin quantum dots in presence of nuclear magnetic mo- 
ments, 7r-fiip-inducing control fields can succ essfully re- 
verse dephasing in spin-echo-type fashion PED This works 
up to time scales at which population decay becomes im- 
portant. 

(ii) Storage in or transfer into a dissipation-free sub- 
space: This strategy utilizes the presence a decoherence- 
free subspace, see Sec. |III A2| 

(iii) Dynamical generation of a dissipative sub-space 
(high frequency "bang bang" control): Here an intense 
high-frequency external perturbation is used to stabilize 
the system, as discussed in Sec. |III A2| 

(iv) Quantum-interference (low-frequency/intensity 
control with state-specific optimization): This case was 
discussed above in Sec. IIIIBI 

(v) "Last minute switching" : The transfer from a state 
within the dccohcrencc free subspace (frequently ther- 
mal equilibrium) into another state at specified target 
time is accomplished by an intense pulsed control ap- 
plied just prior to target time tj. If the target state is 
also decoherence free, this pulse may be administered at 
any time within the allotted time interval. This type 
of control is usually of little relevance, since frequently 
the system-control interaction strength is small, so that 
switching times are comparable to decoherence times or 
the target time. 

(v) Custom design of the control field: This is not 
really an independent strategy but it allows, via con- 
trol theory, an identification of equivalent optimal con- 
trol fields. Among these, one selects the one which can 
most easily be realized in experiment, for example, re- 



garding intensity and temporal behavior. Ideal quantum 
gates should be perfectly shielded from the environment 
yet, upon demand, couple strongly to the control. This 
clearly constitutes contradicting requirements which can 
be alleviated by a compromise developed within an opti- 
mal control scheme. 



IV. STATE-INDEPENDENT OPTIMAL 
CONTROL 

As outlined in the introductory part of this re- 
view, state-independent optimal control plays an im- 
portant tool for the identification of the most effi- 
cient quantum gate realizations. Indeed, the control 
of quantum subsystems using external forces is the ba- 
sis for many recent experiments on Bose condensates, 
qubit s and quantum gates, molecule s, and nanostruc- 

tures | B3 | lUl | lUa | lU3 | lU4 | lU5 | lUB | iu7 | lU8 | lU» | For mogt app l ica _ 

tions seeking the observation or utilization of quantum 
interference effects, a minimization of the interaction be- 
tween the quantum system and its environment is re- 
quired. For most efficient cooling of a quantum system, 
however, maximizing the latter is desirable In this 
section, we shall briefly review three new approaches to 
state-independent optimal control for open quantum sys- 
tems and applications to physical qubit and quantum 
gate implementations. 
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A. Perturbative approach 

Here we discuss a general approach for state- 
independent optimal control for weakly dissipative quan- 
tum systems. The task posed is the execution of a uni- 
tary operation O within the dissipative quantum system 
as perfectly as possible in spite of the presence of an envi- 
ronment and independent of the (unknown) initial state 
of the system. 

This approach differs from earlier work in several ma- 
jor and nontrivial aspects: The cost functional for state- 
independent optimized control of inherently dissipative 
quantum systems avoids the need for repeated solution of 
the kinetic equation of the quantum subsystem's density 
operator during the optimization process and the need 
for a co-state altogether, in contrast to mainstream op- 
timal control for quantum systems discussed in previous 
chapters which is based on cost functi onals constrained 
by the system's kinetic equations! 10 * 12 ^. 

Let us consider the general kinetic equation Eq. (15) 



for the density operator p(t) of a quantum subsystem 
with a contribution from the time evolution under the 
Hamiltonian H(t) containing the external control fields 
and the dissipator D[p]. The latter may be quite general 
but is assumed to be small in the sense of time-dependent 
perturbation theory. In particular, it may be of Marko- 
vian (Li ndblad) or non-Markovian form, see Eqs. (16) 
and (|36"} P4 | 38 | 86 |TTT] The objective is to find an optimal 



control to realize a specified unitary operation O which 
is to be executed within a prescribed time interval [0, tf\. 
The basic idea here is to seek a control which minimizes 
the effect of the dissipator while, at the same time, ex- 
ecuting O as perfectly as possible. In order to motivate 



the cost functional selected below, Eq. (151 is written in 
the interaction picture, 

~ P (t) = uHt)p(t)u(t), 

where U(t) is the time-evolution operator for H(t). 
Eq. (IT5|) takes the form, 



ihp = U\t)D[U{t)p(t)U\t)]U{t), 



(73) 



and describes the action of the dissipator for given con- 
trol Hamiltonian and initial state. In the absence of the 
dissipator, p(t) = p(0) and the time-evolution is per- 
fectly unitary. Confining ourselves to the case of weak 
dissipation Eq. (73 1 is solved iteratively. Replacing, on 
the r.h.s. of Eq. (73 1, p(t') by p(0) gives the solution 



within first-order perturbation theory, 

~p{t) - Po « 4 / U\t')D[U{t')p{0)U\t')]U{t')dt'. 
in J Q 

(74) 

The optimization approach uses two different cost 
functionals: an auxiliary cost functional J to determine 
the optimal solution, and a second one, Jz, is used to 
test the quality of the solution for a set of Z randomly 
selected initial states. The auxiliary cost functional J for 



identification of optimized control fields consists of three 
contributions, 



J=Jo + Jd + Je 



(75) 



The contribution Jo enforces completion of the desired 
operation O (up to a phase) at time t f . Possible choices 
arepS 



Jo = N z 



|Tr{0t[/( t/7 O)}| 2 , 



(76) 



where N is the dimension of the Hilbert space of the 
quantum system, 



J' Q = \Tt{O^U(t f ,0)-l}\ 



(77) 



(lmTr{0t £7(^,0)}) , or (Re Tr{O^U{t f , 0) - 1}) . 
The second contribution, Jjj, seeks to minimize the 
undesirable action of the dissipator at final time t / and 
is written, 



J D = SD ((Tr{(p(t f )- P (0)f})), 



(78) 



where Tr and ((...)), respectively, denote the trace and 
an average over all (pure or mixed) possible initial states. 
sd is a real- valued weight factor to guide convergence. 
The distribution of initial states is chosen according to 
the specific physical system. 

The third contribution controls shape and intensity of 
the control, 



Jf = 



s(t) \e(t)\ dt, 



(79) 



where e(t) is the vector containing the external control 
fields. s(t) is a weight factor, as used before. Note that 
this cost functional J avoids the use of the dependent 
variable p(t), thus avoiding a co-state. The control may, 
in general, enter J e in the propagator U(t, 0) and the 
dissipator explicitly. Therefore, there is no need to eval- 
uate the full kinetic equation Eq. (151. Evaluation of 



J during the optimization process requires calculation 
of U(t, 0), t S (0, t/]. This is done best by solving the 
Schroedinger equation for H (t) as an initial value prob- 
lem with [7(0, 0) = 1, or by using a discretized version of 
the formal time-ordered solution Eq. ([9]). 

An arbitrary minimization algorithm can be employed. 
For algorithms requiring cost functional and gradients as 
an input, variations of J with respect to the control e(t) 
can be computed directly by using, 



6U(t,0) ,. TT/ 
Se(t k ) m^oo 



iAt 5H(t k ) 
~h Se(t k ) 



(80) 

This works also for Hamiltonians in which the field en- 
ters nonlincarly, as long as its dependence remains local 
in time. For complicated dissipators with retarded de- 
pendence upon the control fields this provides a signifi- 
cant reduction in computational effort .33 For microscopic 
models of dissipation, the computation of the retarded 
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dissipation kernel is by far the most time-consuming part 
in the optimization loop. It should also be emphasized 
that the present approach, apart from being designed for 
weak dissipation in a perturbative sense, per se does not 
provide a novel physical mechanism for optimization nor 
does it introduce a bias regarding the selected optimiza- 
tion solutions. As will be shown in the simple examples 
below, there is a multitude of practically equivalent solu- 
tions whose selection is mainly determined by the initial 
guess and the form of J e . By the nature of the prob- 
lem, all these optimal solutions are also good solutions 
for vanishing dissipator. 

Verification of the quality of a solution is performed 
by computation of a test functional Jz which is averaged 
over a set of Z initial states pj , 



J Z = ~J2Tv[( Pj (t f )-Op j O^}. 



(81) 



The initial states pj are distributed randomly according 
to their likelihood of occurrence, consistent with the state 
average in J p. Pj(tf) are the density operators obtained 



from the kinetic equation Eq. ( 15 1 using the optimized 
control fields. Note that merely this performance test 
requires repeated evaluation of the full kinetic equations. 
Moreover, it does not resort to a perturbative account of 
dissipation. 

This approach was originally applied to a dissipative 
qubit, with basis states | 0) and | 1), treated within the 
Lindblad equation.^ Numerical examples will be pub- 
lished elsewhere .™ A general result, however, should be 
mentioned here also. We find that for the weak dissipa- 
tion limit and where (local) optimal minima exist, there 
is a large number of equivalent solutions. This is simi- 
lar to the case of unitary systemsfQ2] As a consequence 
there is considerable freedom regarding the shape of the 
control fields which thus can be used to aid experimental 
implementation. 

This approach has recently been applied to a study 
of the upper limit for the fidelity of single qubit gate fi- 
delities within currently available technology for Joseph- 
son charge qubit realizations. Josephson-junction-based 
qubits, such as flux and charge qubits, have become sys- 
tems of significant attention due to their po tential for 
scalable qubit and quantum gate realizations! 3 * 4 * 5 * 6 * 7 * 8 * 9 ! 
Typical for qubit realizations they suffer from two short- 
comings: they are quantum two-level systems merely 
within approximation and their dynamics is influenced, 
apart from the externally applied control, by an unde- 
sirable coupling to the environment. This leads to state 
leakage from the two-dimensional computational Hilbert 
space of the ideal qubit, as well as undesirable decoher- 
enceP^ Both effects need to be suppressed before scaling 
to larger numbers of qubits becomes meaningful. Tackled 
with the perturbative approach outlined above, among 
the infinitely many equivalent control fields which exe- 
cute the operation for the ideal qubit exactly one has to 
select and optimize these which minimize state leakage 



and dissipation. 

In a Joscphson charge qubit, (see Fig. [17]), the qubit 
is encoded in the number of additional Cooper pairs on 
a superconducting island (none |0) and one |1))P 



4> 



island 

4 



Josephson junction 




a. .. superconducting 
top electrode 

b. .. superconducting 
bottom electrode 

c. .. tunnel oxyde 
layer 



FIG. 17: A superconducting ring is divided by an oxide layer 
(c) into a superconducting reservoir and an island. By proper 
tuning of the controls cj> and V g , one can control the tunneling 
of cooper pairs through the Josephson junctions, which are 
characterized by the Josephson coupling energy Ej and the 
capacitance Cj. For a detailed description see Ref. [3] 



The two control fields ultimately consist of a gate volt- 
age V g which determines the equilibrium charge state 
of the island and a magnetic flux <\> which controls the 
Josephson energy. Leakage from the computational ba- 
sis { |0) , |1)} is accounted for by the adoption of the two 
charge states | — 1) and |2) leading to a four-dimensional 
Hilbert space for the "leaky" qubit. The effective Hamil- 
tonian of the superconducting qubit including leakage 
states and proper system bias readsj 3 -^ 
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where Ej = 2EjCos y 7 ^)- Eq denotes the single elec- 
tron charging energy of the island and Ej = Ej((f>) is the 
Josephson coupling energy, which depends on the exter 
nally applied magnetic flux </>; n g 



c a v„ 



with C g de- 



noting the gate capacitance. It is believed that the dom- 
inant dephasing mechanism is due to background charge 
fluctuations in the vicinity of the gate electrodes! 113 * 114 ! 
Two Lindblad operators i = x, z capturing dephasing 
and population decay were identified as, 



with, 



7i(t)= p / dt'a{t,t'), 
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and, 
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(82) 



Ci(t,t') is a bath correlation function. Thus, fluctuations 
in the gate voltage (cx L z ) lead to dephasing and fluc- 
tuations in the magnetic flux and/or (cx L x ) lead to 
combined population decay and dephasing. The former 
typically occur on a significantly shorter time-scale than 
the latter. 

In addition to the optimization scheme outlined above, 
the superoperator-based scheme introduced in the fol- 
lowing chapter was used to optimize Hadamard gate op- 
eration. This study has revealed that leakage from the 
computational subspace can be largely suppressed, but 
dissipative effects, predominantly due to dephasing due 
to fluctuations in the charging energy, lead to noticeable 
reduction in fidelity below 100 percent. While the latter 
is readily achievable in the sole presence of state leakage, 
for switching times of about 0.5 ns and typical system 
parameters taken from experiment, the predicted opti- 
mal fidelity is about 98 percent in presence of both state 
leakage and dephasing. Effects from fluctuations in the 
Josephson energy are found to be negligible. These re- 
sults are in qualitative agreement with a superoperator 
optimization scheme based on a spin-boson model for 
noise in the leaky qubitP^ 



B. Superoperator formulation of 
state— independent control 

The time evolution of the density operator is expressed 
in terms of a time evolution of a super-operator which 
acts as a linear map on the initial state. As a conse- 
quence the initial state is detached from the time evolu- 
tion. We give an overview of the theory, using a simple 
example, where dissipation is described by a Lindblad 
dissipator. A more elaborate discussion is given in Rcf 30 
where we consider a microscopic dissipator based on the 
spin-boson model and various control Hamiltonians. 



1. Kinetic equations 

We start with the kinetic equation for the reduced den- 
sity matrix of the open quantum system, p(t), Eq. (151. 
The Hamiltonian of the system, H(t), contains the unper- 
turbed system Hamiltonian H and the external control 
H c (t), see Eq, 



(10) . At this point the dissi pator D[p] 
can be quite genera p i ^ro | 6i | ii5 | iis | ii7 | ii8 | We rewrite 

Eq. (p~5|) using superoperators, 



Here C{t) is the usual Liouville-superoperator, whereas 
T>{t) represents the dissipator. For the superoperator 
X(t), defined in Eq. (19 1, we have the equation of mo- 
tion, 



ihX(t) = [C(t)+V(t)]X{t). 



(84) 



Eq. ( 84 I represent the central differential equation for the 
evolution superoperator to describe dissipative quantum 
systems. 



2. Representation of the superoperators and the Lindblad 
dissipator 

We represent the various superoperators in a basis and 
work with the components, using always Einstein sum- 
mation convention. The Liouville-superoperator C(t) de- 
pends on the time-dependent system Hamiltonian H(t). 
The elements are given by, 



— H im (t)S n j — H n j(t)5i, 



(85) 



For a dissipator in Lindblad form, D L , we have the ex- 
pression, 



V 



1 



1 



2 (LjiL^imSjn — - (L^L^njSim^. (86) 

Here are Lindblad-operators, describing the structure 
of the dissipator. For completeness we give also Eq. (83 1 
in components, 

ih Pl3 {t) = [C ijrs {t) + Vf- rs ]p rs (t). (87) 

For the evolution superoperator X(t) we have the equa- 
tions, 



j(t) J rT)^ mr \X mnrs (t\ 



with Xij rs (0) = Si r Sj S and the state-evolution of an ini- 
tial state p(0) is given by, 



Pij(t) = X ijrs (t)p rs (0). 



(89) 



When we compare Eq. ( 87 ) with Eq. ( 88 ) we can see that 
the only, but in practice relevant difference of both is the 
number of differential equations. In Eq. (87 1 this number 



grows as N , whereas in Eq. (88) it grows as N , where 



N is the dimension of the Hilbert space. This makes 
the OCT problem for state independent control includ- 
ing dissipation numerically more expensive. 
For dissipation-less systems, T>fj mn = in Eq. 
one can express the evolution superoperator components 
Xij rs (t), using the usual time-evolution operator U(t), 



ihp(t) = [£(t)+V(t)]p(t). 



(83) 



XijrsH) = U ir (t)UUt). 



(90) 
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3. Cost functional 

We formulate in this section the cost functional and 
the optimization problem. Let O the target operation, 
unique defined up to a physical irrelevant global phase. 
We consider first the transformation of a state, repre- 
sented by a initial density operator p(0). In the ideal 
case the final state is, 



P (t f ) = Op(0)O\ 



(91) 



for any p(0). Considering a pure coherent dynamic we 
obtain the target superoperator Xt, 



Xijr.(if) = U ir (tf)UUtf) 



o ir o\ 3 = (X T ) 



tjrs • 



(92) 



A natural and simple choice for the cost functional is 
therefore, 



J = \\X(t f )-X T \ 



\X n 



/(*/) 



Minimization of J by variation of the control, H c (t) in 
Eq. (10), which enters in Eq. (88 1, defines the task of 



state independent optimal control of dissipative quantum 
systems. One can solve this mathematical problem using 
different methods.^ We remark that Eq. ( 93 I applied to 



a dissipation-less system takes the form Eq. ( 76 I 



We note that this structure of the qubit-qubit interaction 
recently was studied for dissipation-less systems, where 
a minimization of a cost functional of the type Eq. ( 76 I 
has been carried outPHl 



6. Dissipation and Lindblad- operators 

We model the effect of the environment in a simpli- 
fied version also, where two parameters are enough to 
describe the total effects of the system-environment in- 
teractions. To proceed, we need to specify the Lindblad 
operators L^. As we consider two identical qubits, which 
without coupling, H 12 (t) = 0, should evolve indepen- 
dently, the Lindblad operators must have a tensor prod- 
uct structure. For each qubit we use two Lindblad oper- 
ators to describe transitions between the two basis states 
|0) and |1). In particular we set for the four Lindblad 
operators, 

Li = VtT|0)(1| ® 1 - ^7i(|l)(3| + |2)(4|), (97) 



L 2 = vW<0| ® 1 = V7a(|3)(l| + |4)<2|), (98) 



L 3 = Vlll ® |0)(1| = VtT(|1)(2| + |3)(4|), (99) 



4. An example: The CNOT gate 

We consider a simplified model for a Josephson two- 
qubit system a nd app ly the theory presented before to 
the CNOT gatePSSS] The example is chosen in order to 
demonstrate the strategy. To describe the system we use 
the product states of the computational basis, |0)|0) = 
|1), |0)|1) = |2), |1)|0) = |3), |1)|1> = |4). The target is 
the unitary operator, 



O 



( \ o\ 

10 
1 

V 1 ) 



(94) 



5. Hamiltonian of the system 

Josephson charge qubits are optimal controllable quan- 
tum systems. Control of the wave function can be achieve 
by tuning gate voltages and magnetic fluxesP The single 
qubit Hamiltonians (i — 1,2), 



ffW(t) 



(t)<T x 



■ £ 



(i) 



(t)a z 



(95) 



offer full control over both independent qubits. The con- 
trol fields are e£}z{t). For the qubit-qubit interaction 
H 12 (t) we set (with C a constant), 

H 12 {t) = Cel{t)el{t)a y ®a y . 



(96) 



nP®|l)(0| = V72(|2)<l| + |4)<3|). (100) 



For simplicity we use the same rates 71^ for both qubits. 
Dephasing and relaxation in the one-qubit system occurs 
during the times, 



To 



7i + 72 



71 + 72 



(101) 



In our model the unbiased single qubit, e x {t) — 0, relaxes 
to the equilibrium state, 



71 



JX) = I 71+72 

Pcq I 





72 



(102) 



71+72 



We note that only for 71 = or 72 = this is a pure 
state, in general hoverer, Eq. (102) describes a mixed 



state. The equilibrium state of the two-qubit-system is 
the product state, p cq 



Peq 



>P ( eq- 



7. Numerical study 

In order to obtain further results we have to compute 
the kinetic equation Eq. (88 1 numerically. We assume 



given rates 71.2- To solve the optimization problem, we 
set up the fields by a Fourier series, 



e(t) = a k sm(u>kt) , 



k=l 



kit 



(103) 
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All four control fields are expressed by such a decom- 
position, with a priori unknown coefficients. Whit this 
Ansatz we have for F — > oo a complete function system 
and we have incorporated also boundary conditions, in 
our example, e(0) — s(tf) — 0. When the coefficients are 
known, we can compute the evolution superoperator us- 
ing the kinetic equation, Eq. (88 1 and the cost functional 



Eq. (93 1. We start with a set of guess coefficients and 



minimize Eq. (93 1 using standard line search routines. 
We set F = 8 coefficients for each control field. De- 
cay rates are chosen as 71 if = 72*/ = 0.1, the constant 
C = tf/h. The cost functional is in the unitary case of 
the order J w 1CP 7 and with dissipation is J = 0.1678. 
Results are shown in Fig. [18] The optimal control fields 
are plotted in (a) and (b). The lower part of the figure 
shows the absolute values of the superoperator elements. 
The bars in (c) represent the ideal values and in (d) we 
plot the values obtained by using the fields shown in (a) 
and (b). The norm of x decreases from ||x(0)|| 2 = 16 to 
||x(i/)|| 2 = 13.15. In order to demonstrate the action of 
the dissipator we choose very strong decay rates. After 
one gate operation the norm of x l° se about 20% of its 
initial value. 



C. Optimal control within the Kraus operator 
representation 

Recently, a theoretical study of the Josephson charge 
qubit was performed to identify its performance lim- 
its within current experimental meansJ22 It accounts for 
state leakage, dissipation and decoherence and is based 
on a Kraus representation of the time-evolution super- 
operator, see Sec. |II C| The Hilbcrt space of the system is 
divided into the computational subspace C over which the 
desired quantum operation is defined, and the remaining 
space C is spanned by potential "leakage" states. The full 
Hilbert space (without environment) is the direct sum, 
C©£. 

State-independent optimization is performed as fol- 
lows. One considers a map, p(0) 1— > p(t) = £ t {p(0)}, 
for which the superoperator £ t is functionally dependent 
upon the control field e(t), i.e., £ t — £t[e\. Since pos- 
itivity of the density operator p(t) must be conserved, 
the map £ has to be completely posi tive an d thus can be 
represented by Kraus operators K m } 41 ^ 12 ^ 



P {t) = Y^K m [e]{t)p{Q)Kl[e]{t)- 



(104) 



The optimal control field e*(t) is selected such that, at 
some final time tf, £t f [s*] approaches the desired map- 
ping £° as closely as possible. For given quantum gate 
operations, 



£° {.} = ©(.) 0\ 



(105) 



the cost functional within the language of process to- 
mography (see e.g. Refs. 1121( 122). The mapping £ 
can be expressed by expanding the Kraus operators, 
K m {t) = J2 n a mnK n , with a mn € C and K n £ A, 
wher e A denotes a complete basis set of M x M ma- 
tricesP^H-M = Mc + Ml, where Mq and Ml correspond 
to the number of (orthonormal) computational and leak- 
age basis states, respectively. The state of the quan- 
tum system at tt and starting out in p(0) now reads, 

p(t f ) = £t f {p{0)} = E m , n Kmp(0)KbCmn(tf), with 
= J2k a kmC(* kn . For evaluation of the process to- 
mography matrix Xi one chooses a fixed set of operators 
{o-j} — B (for simplicity we choose B = A) and determine 
the time-evolution of these operators with respect to the 
mapping £, <Tj(tj) = £ tf {(7j} = Y*k c ik°~k- Eq. ( |104[ ) is 
a linear mapping and one can obtain \ by computing the 
time evolution of the set B to fully characterize the quan- 
tum operation performed. However, calculating the time 



evolution using Eq. (1041 is often intractable. Hence, one 



may want to approximate the dynamics of the system by 
employing e.g. perturbative methods. A short descrip- 
tion of appropriate techniques for the spin-boson model 
is given in Sec. |II B 2| 

For convenience, we define operators x = 

Em,n (^®-^m)xmnP and formulate a simple 

cost functional,^ 



Px-x 



o 



tr 



{[Px~x°] [Px~x°]'} 



where O denotes the desired unitary operation. For 
quantum information theory it is useful to formulate 



(106) 

where P denotes the projector onto the Afp-dimensional 
computational Hilbert space C and < J < J m ax = 
2Mp. J measures the norm distance between the target 
operation x , corresponding to the mapping £° , and the 
actual operation x executed at time tf for control field 
e. 



V. CONCLUSION AND OUTLOOK 

Over the last two decades optimal control of quantum 
dynamics has become a mature field with applications in 
many areas of physics and chemistry. In its beginning 
it dealt with state-dependent control of unitary systems 
within the Schrodinger equation. Nowadays, one deals 
with open quantum systems obeying more or less com- 
plex master equations to study dissipative effects in quan- 
tum systems, such as quantum gate realizations or Bose 
condensates. 

In this article we have presented recent progress in op- 
timal control theory applied to the dynamics of open dis- 
sipative quantum systems. While we have exclusively 
presented our own results, we have tried to reference rele- 
vant work and alternative approaches which are available 
in the literature. Special focus was given to approaches 
which allow external control of the effective system-bath 
interaction. The motivation for investigating this aspect 
in particular lies in the recognition that most effective 
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FIG. 18: CNOT gate: (a), (b) shows the control fields of both qubits respectively in units of h/tj. In (c) are shown the 16 x 16 
elements of the target superoperator, which must be compared to the result of numerical optimization (d). 



control of the system-bath interaction has to be admin- 
istered at the quantum level, i.e., on a time scale for 
which the system-bath interaction reveals its quantum 
nature. 

The presented work covers two main tasks: state- 
dependent control and state-independent control. The 
first task is important when one wishes to prepare a 
quantum system in a specific state, starting from a pre- 
determined initial state, usually its ground state. For 
this case, we reviewed standard optimal control theory 
and an extension to non-Mar kovian systems. The latter 
approach has been applied to a model system to demon- 
strate quantum interference effects in the control of the 
effective system-bath interaction (dissipation). Further- 
more, we reviewed analytic solutions for dissipative two- 
level systems which solve the optimization problem by 
direct inversion. As an example, optimal control fields 
for inducing Rabi oscillations in a dissipative two-level 
system have been derived. While direct inversion is lim- 
ited to simple models, it allows the derivation of absolute 
bounds for controllability. In general, numerical meth- 
ods provide local minima only. This holds particularly 
for conjugate-gradient methods. Global minima can be 
found, in principle, by evolutionary algorithms, however, 
at the expense of a large number of evaluations of the 
cost functional. 

Three recently developed approaches to state- 
independent optimal control were presented. A first- 
order perturbative approach of the system-bath inter- 
action was formulated which determines optimal con- 



trol fields using an auxiliary cost functional consisting 
of three parts which, respectively, enforce execution of 
the quantum operation, minimization (maximization) of 
the system-bath interaction, and the desired shape of 
the control. Application to SQUID-based qubit realiza- 
tion was reviewed. A completely general approach based 
on the time-superoperator representation was presented. 
It provides the most general possible representation of 
state-independent optimal control for open quantum sys- 
tems. A third related approach based on the Kraus op- 
erator representation of the time-evolution superopera- 
tor and a formulation of the cost functional within pro- 
cess tomography we specially developed for application 
to quantum-information processing. 

An attempt was made to render the presentation 
widely applicable throughout quantum physics. Our 
physical examples, however, were restricted to solid-state 
realizations, in particular quantum dots and SQUIDS. 

The need for a microscopic description to fully exploit 
the potential of control of quantum systems naturally 
leads to numerical complexity limiting such models to el- 
ementary quantum systems at present. Moreover, quan- 
tum information processing will require studies regard- 
ing scaling behavior of dissipative effects with quantum 
gate array size. It is therefore important to reduce com- 
plicated many-body systems to simple effective models, 
whenever possible. Several such models were reviewed: 
the Lindblad equation, the spin-boson model and the 
spin-bath model. 

While this article has discussed optimal control from 
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a theoretical point of view, it can also be executed in 
conjunction with experiment. For example, using feed- 
back control, optimal control fields can be determined 
in a learning cycle. Pulse shaping in ultra fast laser 
spectroscopy is a representative example for this strat- 
egy. Clearly, interplay between theory and experiment 
will be beneficial and is inevitable for modeling experi- 
mental setups. 
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